Papers with pretrained decoder-only language models
ImpRAG: Retrieval-Augmented Generation with Implicit Queries (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) systems treat retrieval and generation as separate processes, requiring explicit textual queries to connect them. |
| Approach: | They propose a query-free RAG system that integrates retrieval and generation into a unified model. |
| Outcome: | The proposed system can achieve 3.6-11.5 accuracy improvements on unseen tasks . it allows models to express their information needs without human-specified queries . |